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O 

^ ■ Abstract 

^ I A waveguide G lies in M"^^, n > 1, and outside a large ball coincides with the union 

of finitely many non-overlapping semi-cylinders ("cylindrical ends"). The waveguide 
■ is described by the operator {C{x,Dx) — fi, B{x, D^)} of an elliptic boundary value 

I problem in G, where £ is a matrix differential operator, ^? is a boundary operator, 

and fi is a spectral parameter. The operator {C, B} is self-adjoint with respect to a 
' Green formula. The role of C can be played, e.g., by the Helmholtz operator, by the 

, operators in elasticity theory and hydrodynamics. As approximation for a row of the 

scattering matrix S{fi), we take the minimizer of a quadratic functional J^(-,/u). To 
construct the functional, we solve an auxiliary boundary value problem in the bounded 
domain obtained by truncating the cylindrical ends of the waveguide at distance R. As 
R — )■ oo, the minimizer a{R, fi) tends with exponential rate to the corresponding row of 
the scattering matrix uniformly on every finite closed interval of the continuous spec- 
^ . trum not containing the thresholds. Such an interval may contain eigenvalues of the 

lO ! waveguide with eigenfunctions exponentially decaying at infinity ("trapped modes"). 

' Eigenvalues of this sort, as a rule, occur in waveguides of complicated geometry. There- 

l/^ • fore, in applications, the possibility to avoid worrying about (probably not detected) 

\^ i trapped modes turns out to be an important advantage of the method. 

o 

1 Introduction 

^ . The waveguide to be considered in the paper occupies a domain G in W'^~^ having several 



cylindrical outlets to infinity ("cylindrical ends"). This means that outside a large ball cen- 
tered at the origin the domain G coincides with the union of non-overlapping semicylinders 
n^,...,n^; here = {{yP,tP) : yP G nP,tP > 0}, iyP,tP) are local coordinates in H^, 
and the cross-section Qp of the cylinder 11^ is a bounded n-dimensional domain with smooth 
boundary dQP. The waveguide is described by the operator {£(x, D^) — fi,B{x, D^)} of 
an elliptic boundary value problem in G, where £ is a matrix differential operator, S is a 
boundary condition operator, and /i is a spectral parameter. The operator {£, B} is self- 
adjoint with respect to a Green formula. At infinity, the coefficients of C and B stabilize with 
exponential rate in every semicylinder to functions independent of the axial variable. 
Let us consider the homogeneous problem 

{C{x,D^^) ~ fi)u{x) = 0, xeG, (1.1) 
B{x,D.^)u{x) = 0, xedG. 



^The work of both authors was supported by Russian Foundation for Basic Research project 09-01-00191-a 
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We assume that the interval [fii, ^2] C M belongs to the continuous spectrum of the operator 
{£ — II, B} and contains no threshold values of the spectral parameter. In other words, 
for every fi G [fii, (12] there exists the same (finite) number of solutions to the problem 
(11. ip linearly independent modulo L2{G); such solutions are called eigenfunctions of the 
continuous spectrum. The interval [fii,fi2] may contain eigenvalues of the problem (11.11) 
with eigenfunctions in L2{G). Any eigenfunction in L2{G) is exponentially decaying at 
infinity while the eigenvalues are of finite multiplicity and can not accumulate in [/ii,/i2]. 
Thus, when fi G [fii, ^2] turns out to be an eigenvalue, the number of bounded solutions 
linearly independent in the ordinary sense increases and yet the number of solutions linearly 
independent modulo L2{G) (or, equivalently, modulo exponentially decaying terms) remains 
constant on [/xi, ^2]', denote the number by M. For any /i G [/Xi, /X2] in the space of continuous 
spectrum eigenfunctions there exists a basis Y'i(-, /x), . . . , Ym{-, ij) modulo L2{G) such that 

M 

Yj{x, jj) = M+(x, /i) + ^ Sjk{fJ')u^{x, jj) + ©(e"^!"^!) 

fc=i 

for \x\ —7- 00 and j = 1, . . . , M; here £ is a sufficiently small positive number, u"j{-,ix) are 
incoming waves while u~{-,^) are outgoing ones (precise definitions see in 2.2). The matrix 
S{fi) = WSjkifJ')]] is unitary; it is called the scattering matrix. 

The paper is devoted to justification of an approximate computation method for the 
scattering matrix. A detailed description of the method has been given in 12.31 In brief as 
an approximation to the l-th row Si{fi) = {Si^i{fi), . . . , 5*;^/ (yu)) of the scattering matrix we 
take the minimizer a{R, fi) of a quadratic functional jp-{-,fi). The functional is constructed 
by solving an auxiliary boundary value problem in the bounded domain G^ obtained from 
G by cutting off the cylindrical ends at a sufficiently large distance R from the origin. In 
the present paper, we prove that for Rq and all /i G [fii, ^12] there holds the estimate 

||a(i?,/x)-5K/i)KCe-^^ (1.2) 

with some positive numbers A and G that are independent of R and fi. Thus, as i? — )■ 00, the 
minimizer a{R, fi) tends to the corresponding row of the scattering matrix with exponential 
rate uniformly with respect to /i G [/ii,yU2]- 

As mentioned above, the interval [ni, H2] of the continuous spectrum may contain 
eigenvalues of the operator {£ — fi,B}. In nonhomogeneous waveguides of complicated 
geometry, as a rule, there occur trapped modes, that is, eigenfunctions exponentially decaying 
at infinity. Therefore, in applications, the possibility to avoid worrying about (probably not 
detected) trapped modes turns out to be an important advantage of the method. 

For the Helmholtz operator in a close situation, the method under discussion was 
suggested in [Tj. The justification of the method in [1] made use of Proposition 3 there 
(presented without proof), which is valid only if the interval [^1,(12] is free from the eigen- 
values of the waveguide; this restriction was not indicated in Proposition 3. (In our context 
the restriction would mean that [/ii,/i2] must be free from the eigenvalues of the operator 
{C — fi,B} in G.) In the presence of waveguide eigenvalues in [fj,i,fj,2], the inequality (11.21) 
was proved for the Helmholtz operator in [2]. The proof given in the present paper for the 
general elliptic problems is new for the Helmholtz operator as well and is simpler than that 
in [2]. In contrast to [2j, we here do not construct an approximate solution to the problem 
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in G . Instead, we use a simple estimate on its solutions which is uniform with respect to 
R > Rq and G [/ii,/i2] and is indifferent to the presence in [;Ui,/i2] of eigenvalues of the 
operator {C — ^, B} in G. 

The statement of basic boundary value problem, the precise definition of scattering 
matrix, the detailed formulation of computational method, and the statement of principal 
Theorem 12.31 are given in §2. The solvability of an auxiliary problem in the domain G^ is 
discussed in §3. In §4, we complete the justification of method by proving Theorem 12.31 

2 Statement of the problem. Formulation of the re- 
sults 

2.1 Boundary value problem 

Let G be a domain in M""*"^ coinciding, outside a large ball, with the union 11^ U . . . U II;^ 
of non-overlapping semicylinders = {(y^, t^) : € > 0}, where {y^,t^) are local 

coordinates in 11^, the cross-section DP of 11^ being a bounded domain in R"-. The boundary 
dG of G is supposed to be smooth. We introduce a formally self-adjoint {k x /c)-matrix 
\\Cij{x, Dx)\\ of differential operators in G, where ord£jj = Tj + Tj with nonnegative integers 
Tj and Ti + . . . + Tfc = m. We also assume that the Green formula 



holds for all u,v & C^{G), while the (m x A;)-matrices B = \\Bqj\\ and Q = \\Qqj\\ consist of 
differential operators such that oidBgj = aq + Tj, aq being an integer, and ord + ord Qqi ^ 
Tj + Tj — 1; here (■, ■)g and (■, ■)dG stand for the inner products on L2{G) and L2{dG). The 
coefficients of £, B, and Q are smooth in G. We suppose that the operator {£, B} of 
boundary value problem in G is elliptic. 

Remark 2.1. We have used the (widest) ellipticity definition in the sense of Agmon-Douglis- 
Nirenberg in order to include in consideration, among others, some hydrodynamics problems. 
The other ellipticity definitions can be obtained from that as special cases. For instance, 
the scalar case corresponds to k = 1, Ti = m, and ord£ = 2m; the boundary operator B 
is a column {Bi,...,Bm} with ordBh = mu- A detailed description of various ellipticity 
definitions as well as examples can be found, e.g., in [3]. 

Let us describe the coefficients of C and i3 in a neighborhood of infinity. Denote 
by {LP, 5^} an elliptic boundary value problem operator in the cylinder 11^ = x M 
with coefficients independent of G M and smooth in QP^ while ordL^^- = ord£jj and 
ord-Bf- = oidBij. We assume that any coefficient a of {C,B} satisfies 



in for — )■ +00, where aP is the corresponding coefficient of {L^, -B^} and 5 is a positive 
number. From (12.1 p it follows that there holds the Green formula in every cylinder 11^ 
obtained from (12.11) by changing G for 11^ and £, S, and Q for L^, B^, and Q^. 



{Cu, v)g + {Bu, Qv)aG = {u, Cv)g + {Qu, Bv)og 



(2.1) 



D'^ {a{yP,tP) - a^iy^) = 0(exp(-5t^')) 



(2.2) 
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We consider the boundary value problem 

r D^)u{x) - fiu{x) = 0, X eG, , . 

\ B{x,D,^)u{x) = 0, xedG, ^ ' 

with spectral parameter /i G C. A number fi is called an eigenvalue of the operator {£, B}, 
if there exists a nonzero function u G L2{G) smooth in G and satisfying f l2.3p . Such a 
function is called an eigenfunction corresponding to the eigenvalue /i. From the Green 
formula it follows that any eigenvalue is real. Every eigenfunction admits the estimate 
u{y^, t^) = 0(exp(— xt^)) for — )■ +oo in each 11^ with a certain x > 0. For any eigenvalue 
there exist at most finitely many linearly independent eigenf unctions. 



2.2 Space of waves. Scattering matrix 

To simplify notation, we sometimes drop the superscript p, if the context excludes misun- 
derstanding. In every domain Q = we introduce the operator pencil 

C 9 A 2l(A, /i) = {L(A) - fil, 5(A)}, 

where ^^(A) = L{y, Dy, A), -B(A) = B{y, Dy, A), so we have the pencils 2l^(A, fi), . . ., 2l^(A, /i). 
Let us fix, for the time being, the parameter n. Considering A as spectral parameter of the 
pencils, we shall use the same terminology as in The spectrum of 2t(-,/i) is symmetric 
about the real axis and consists of normal eigenvalues, that is, isolated eigenvalues of finite 
algebraic multiplicity. Every strip {A G C : |ImA| < h < oo} contains at most finitely many 
eigenvalues. It is known (see [5]) that the total algebraic multiplicity of the eigenvalues of 
2l(-,/i) in the strip {A G C : |ImA| < h} is even for any /i > 0; in particular, the total 
algebraic multiplicity of the real eigenvalues is even. 

If /i is not a threshold, then for any real eigenvalue of there exist only eigen- 

vectors and no generalized eigenvectors. We number all real eigenvalues of the pencil 2l^(-, /i) 
counted according to their (geometric) multiplicity. Let A^, . . . , X2MP ^^^^^ eigenvalues 

and let (pi, . . . , (P2MP be the corresponding eigenvectors. The functions 

W 3 {y,t) ^ ul{y,t) = exp{zXlt)^l{y) 

satisfy the homogeneous problem 

r (LP(2/, Dy, A) - l^)v{y, t) = 0, (y, t) G n^; 

\ BP{y, Dy, DMy, t) = 0, {y, t) G dW. ^^'^^ 

Introduce 



\i u,v G C^iJlP), then qP{u,v) = 0. Assume that x e C^{R), x{t) = 1 for t ^ 2 and 
x(t) = for t ^ 1. The form extends to the pairs {xUpX'^k}^ there is valid the 
following assertion (see [5]). 

Proposition 2.2. The eigenvectors {^p^} can be chosen to satisfy q^ix'^^^jiX'^V) ~ '^'^^jk; 
while the sign is determined and cannot he taken arbitrarily. 
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We extend the functions X'^fc by zero from to the domain G keeping the same 
notation for the extended functions. Introduce a space Eofw& C°°{G) satisfying D°'w{x) = 
0{exp{—(3\x\)) as |a;| — )■ +00 for any muhiindex a and some positive (3 < 6, where 6 is the 
number in fl2.2p . Let W stand for the hnear span of functions X'^k + w with w E E. The 
form 

q{u, v) = {Cu, v)g + {Bu, Qv)og - {u, Cv)g - {Qu, Bv)dG (2.5) 

takes finite values for any u,v E W. It is evident that q{u,v) = —q{v,u) and q{u,u) G iR. 

By definition, m G W is an incoming (outgoing) wave, if iq{u,u) > {iq{u,u) < 0). In the 
space W one can choose the basis 

p 

ut,...,u+,,u^,...,UM, M = ^MP, (2.6) 

p=i 

subject to the conditions 

q{uf,u^) = TtSjk, q{uf,u'^) = 0, j, k = 1, . . . , M; (2.7) 

here uf, . . . , u~lf are incoming waves and m^, . . . , -u^j are outgoing ones. 

Let 7 be a positive number such that 7 < 5 and the strip {A G C : |ImA| < 7)} 
contains only real eigenvalues of the pencils 2l^(-, /i), p = 1, . . . , P, for all G [/ii, /i2]. It is 
known [5] that in the space of bounded solutions to the problem (12. 3p there exist elements 
Yi{-, yu) . . . , Ym{-, fJ') such that 

M 

Y^{x,fi) = u+{x,fi) + 5]5,fc(/i)n^(x,^) + O(e-^l-'l) (2.8) 

k=l 

as |x I —J- 00. If the number /i is not an eigenvalue of the problem (12. 3p . then l^(-,/i) are 
uniquely determined and form a basis in the space of bounded solutions to the homogeneous 
problem (12. 3p . that is, in the space of continuous spectrum eigenfunctions. Otherwise, any 
Yj{-, fi) is determined up to an eigenfunction of (12. Sp belonging to L2{G) . Then any bounded 
solution of (12. 3p can be represented by a linear combination of Yj{-, fi) up to an eigenfunction 
in L2(G). 

The matrix S{^) = ||5'jfc(/^)||j;l=i in (12.80 has uniquely been determined for all fi G 
[yUi,yU2]; it is independent of the arbitrariness in the definition of Yj{-,fi) when /i is an 
eigenvalue. The matrix S{fi) is called the scattering matrix. It is unitary for all fi. 

In what follows we do not usually indicate the dependence of uf, Yj, etc., on the 
spectral parameter fi. The context excludes misunderstanding. 

2.3 Method for computing the scattering matrix. Formulation of 
the principal theorem 

For large R we introduce 

n^^ = {(yp, tp) G np : > i?}, = G \ uf^iH^"^ 
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and set 

dG^ \dG = T^ = UpPP'^, r^'^ = {{yP, tP) eW ■.tP = R}. 

Then 

{Cu,v)GR + iBu, Qv)qgr\vr + {J^u,'Dv)yr = {u, Cv)GR + iQu,Bv)gGR\rR + i'^u,Afv)rR, (2.9) 

where V and A/" are (m x A;)-matrices of differential operators, V being a Dirichlet system 
(see [8]). An example of Dirichlet system is presented by the matrix consisting of m rows 
of the form e^^^d^^, where j = 1, . . . , A;, = 1, . . . , r-,- — 1, e^^^ = (5ij, . . . , Skj), and u is the 
outward normal to F^. 

We look for the row {Sn, . . . ,Sim) of the scattering matrix S = S{fi). As approxi- 
mation to the row, we take the minimizer of a quadratic functional. To construct such a 
functional we consider the problem 

{C{x,D^) - = 0, xeG^, 

13{x,D^)Xi^ = 0, xedG^\r^, (2.10) 



(Ar + <P)A',^ = (Ar + <P)« + ^.^ a,w7),xGr^ 



where C is a fixed number in R \ {0} and ai, . . . ,aM are complex numbers. 

Let us explain the origin of the problem. A solution Yi of the homogeneous problem 
(12. 3p satisfies the two first equations (12.101) . The asymptotics (12.81) can be differentiated so 

M 

{Af + iCV)Yi = {Af + iCV){ui + ^ aju]) + 0(6^^^) 

i=i 

for aj = Sij. Thus ¥[ gives an exponentially small discrepancy to the last equation (12.101) . As 
approximation to the row {Sn, . . . , Sim), we take the minimizer a°(i?) = (a5(-R), . . . , a^(i?)) 
of the functional 

M 

{ai,...,aM)^ Jp{ai,...,aM) = ||P(A',^ - < - a.-w"); L2(r^)f , (2.11) 

i=i 

where Xf^ is a solution to the problem (I2.10p . One can expect that a^{R) — > Sij with 
exponential rate as — )• oo and j = 1, . . . , M. 

To clarify the dependence of on the parameters Oi, . . . , om, we consider the prob- 
lems 

mx,D,)-fi)vf = 0, sgG^; 

B{x,D^)vf = 0, xedG^\r^; (2.12) 
{Af + iCV)vf = {Af + tCV)uf,xeT'^; j = l,...,M. 

It is evident that = v^^ + J^j'^j'^Jw where = v^j^ are solutions to fl2.12l) . We 
introduce the (M x M)-matrices with entries 
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and set 

Now the functional (12. lip can be written in the form 

jP{a) = {aS^, a) + 2Re {J^i^, a) + g^, 

where J-/^ is the /-th row of the matrix J-"^ and (■, ■) is the inner product on C^. The 
minimizer aP (a row) satisfies aP{R)£^ + J^^ = 0. Therefore, as approximation S^{fi) to the 
scattering matrix S{fi) we have a solution of the equation S^S^ + J^^ = 0. 

Theorem 2.3. Let ( be any fixed number m M \ {0} and let the interval [/ii, yU2] of the con- 
tinuous spectrum of problem Ii2.3\) be free from the threshold values of the spectral parameter 
fi. Then for all /i G [/^i, /i2] cind R> Rq, where Rq is a sufficiently large number, there exists 
a unique minimizer a^{R, jj) = {a^{R, /x), . . . , a1^{R, /x)) of the functional J[^{-; [j) in h2.11\) . 

The estimates 

|a;(i?, ^^) - Si.ifi) I < Ce-^^, j = 1, . . . , M, 

hold with constant C independent of fi and R, while A = min{/3,7}, P is a positive number 
less than 6 in ^2.^) . 7 is the same as in ^2.8\) . 



3 Problem in the domain G 

Introduce the boundary value problem 

C{x, Dx)u{x) — fiu{x) = f{x), X G G^, 

B{x,D^)u{x) =g{x), xedG^\T^, 
{Af{x,D,)+z(V{x,D,))u{x) =h{x), xgT^ (3.1) 

where ( G R\{0} and /i G M. In this section we discuss the unique solvability of the problem. 

The boundary dG^ contains dT^, which is an edge for dimG > 2 or the union of 
corner points for dimG = 2. The boundary conditions have discontinuities along dT^. 
When studying problem fl3.ip . one can use the traditional scheme of the theory of elliptic 
boundary value problems in domains with piecewise smooth boundary (see, e.g., [S], [B], 
[7]). In contrast to the smooth situation, the choice of function spaces for a boundary value 
problem has not been universal and requires taking into account the specific properties of 
solutions near the edges; sometimes weighted function spaces turn out to be suitable for the 
purpose. For the classical problems in mathematical physics the needed spaces are known. 
For those reasons we restrict ourselves to considering some specific features of problem (13. ip , 
examples, and postulating the needed properties of function spaces to be used. 

Assume that the function spaces for problem (13. ip have been chosen so that the 
operator of the problem is Fredholm (having closed range and finite-dimensional kernel 
and cokernel). Then the triviality of kernel and cokernel is necessary and sufficient for 
the existence of a unique solution to the problem with any right-hand side. To prove the 
triviality, note that (12.90 leads to 



(£ - fi)u, v)gr + (Bu, Q'y)aG«\r« + ((-^ + iC'^)u, Vv)yr 
= (m, (£ - h)v)gr + (Qm, Bv)qgr\vr + ("^m, {M - iC'D)v)rR- 



(3.2) 
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Let w be a solution to the homogeneous problem (13. ip . Setting u = v = w in 03.21) . we 
obtain 

||Pw;;L2(r«)|| =0. (3.3) 

This and the homogeneous boundary condition {N'{x, D^) + i(V{x, Dx))w{x) = for x G F'^ 
imply that w has zero Cauchy data at F^. If the coefficients of the operator are sufficiently 
smooth for the applicability of the unique continuation theorem (see [H], part II, §1.4), then 
we obtain the triviality of kernel. Similar considerations for the adjoint problem provide 
the triviality of cokernel. It is supposed that the function spaces where the problem (13.11) 
is considered admit such a reasoning. We illustrate this scheme of the analysis of problem 
(13. ip by the two following examples. 

Example 1. We assume that dimG = 2 and consider the problem 

{A-ij)u{x) = fix), X G G^, 

u{x) = g{x), xedG^\T^, 
d^u{x) + iCu{x) = h{x), X G F^. (3.4) 

With every corner point of the boundary dC^ we associate the problem with complex pa- 
rameter (operator pencil) 

{dl-X^)v{u) = 0, u;G (0,7r/2), 

^;(0) = v'{n/2) = 0. (3.5) 

The spectrum of problem (13. 5p consists of simple eigenvalues Ag = {2q + where q = 
0, ±1, . . . , while u I—)- sin(2g + l)uj is an eigenfunction corresponding to Xg. 
Introduce the space Vl(G^) with norm 



1/2 



\a\<l 

where /3gM, / = 0,1,..., and r denotes a function that coincides near a corner point with 
the distance to the point, equals 1 outside a neighborhood of the corner points being smooth 
and positive on (except at the corner points). Let also Vl^'^^'^ {dG^ \ T^) and V^~^''^(F-^) 
with / = 1, 2, . . . stand for the space of traces of the functions in V^{G^) on dG^ \ F^ and 
F^ respectively. 

The operator A^{fi) of problem (13. ip implements a continuous mapping 
If (G«) 3u^ A^ifi)u = {/, g, h} G V^iG^) X V^^^dG^ \ F«) x <'(F^). (3.6) 

It is known that the operator (13. 6p is Fredholm if and only if /3 — 1 coincides with none 
of the numbers ImA^, that is, A^{^) is Fredholm when /3 is not even. If w satisfies the 
homogeneous problem (13. ip and w G V^{G^) with a certain /3 G (2q, 2q + 2) for an integer 
q, then near a corner point 



wix) 



Cr^"^^ sin(2g + l)w + 0(r2'?+2-=) 
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where r, w are polar coordinates centered at the corner point, C is a constant, and e is any 
positive number subject to e < 1. Hence for every element in the kernel of the operator 
fl3.6p with (3 G (0,2), the formula (13. 3 P holds, which now takes the form L2(r'^)|| = 0. 
Therefore the kernel is trivial for /3 G (0, 2) and consequently for all /3 < 2. 

We turn to the cokernel. Denote by VZ^p{G^) the space adjoint to Vp{G^) with respect 

to the inner product on L2{G^). Let V^_^ ^/^^y^) stand for the space adjoint to Vl^^^^'^{r^) 
with respect to the inner product on L2(r^), / = 0, 1. Finally, denote by A^{fi)* the operator 
adjoint to the operator (13. 6p . 

^^(/i)* : K_°^(G^) X k://'(9g^ \ r^) X vr/'(r^) -> k:|(g^). (3.7) 

The cokernel of operator (13.61) coincides with the kernel of operator (13. 7p . According to the 
known results on the regularity of elliptic problem solutions, for any element {u, v, w} in the 
kernel of (13. 7p there is the inclusion 

{u, V, w} e v,%iG^) X v.'llidG^ \ r^) X Ki/J(r«), (3.8) 

the function u satisfies the homogeneous problem (13. 4p with + iC replaced for (9^ — i( in 
the boundary condition at T^, while v and w are determined by 

v{x) = -9^m(x), X e dG^ \ r^; w{x) = u{x), x e T^. (3.9) 

The above discussion of the kernel triviality of operator (13. 6p does not depend on a sign of 
(. Therefore taking into account (13. Sp . we obtain u = for all /3 such that 2 — /3 < 2. By 
virtue of (13. 9p . for the same /3 we have v = and w = 0. Thus if /3 G (0, 2), then both kernel 
and cokernel of (13.61) are trivial. It follows that for /3 G (0, 2) and for all /x and ( ^ 0, the 
operator (13.60 is an isomorphism. Moreover, it can be shown that, for the even numbers (3, 
the range of the operator is not closed, the cokernel is nontrivial for /3 < 0, and the kernel 
is nontrivial for /3 > 2. □ 

Slightly modifying the statement of problem (13. ip . it is sometimes possible to do 
without edges at the boundary and discontinuities in the boundary conditions. Then the 
analysis of the problem becomes simpler, while all the rest in the sequel requires no essential 
changes. 

Example 2. Let the role of initial problem (12. 3 p be played by the Neumann problem 

{C{x,Dx) - fi)u{x) = f{x), xeG, 
M{x,Dx)u{x) = g{x), X & dG, 

where C is the same matrix differential operator as in (12. 3p . Denote by G^ the bounded 
domain with smooth boundary obtained from G by cutting off the cylindrical end 11^ by a 
surface f^'^ such that f^'^ C {{yP, tP) e Ul : R < fP < R+1}, p =1, . . . , P. As R varies, the 
surface F^' moves in a parallel way along the axis of n^. We set F^ = UpF^'^. Let us choose 
a smooth cut-off function x on dG^ such that suppx C F-^ and mes{a; G F^ : x{^) = 1} > 0. 
Instead of (13. ip . we introduce the problem 

C{x, Dx)u{x) — fiu{x) = /(x), a; G G^, 
iAf{x,D^)+tCxV{x,D^))u{x) =g{x), x G 9G^. (3.10) 
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There is the Green formula 

dGR 

= {u, (£ - ix)v)^n + (Vu, {U-iCxV)v)Q^n. (3.11) 
The operator A^{^) of problem (13.101) implements a continuous mapping 

k km 

^^(/i) : JJi7'+"+"^(G^) ^ JJ/f'+"-"^(G^) X WH^-'^^^-^'^i^dG^), (3.12) 
j=i j=i h=i 

where H^{G^) and H^[dG^) are the usual Sobolev spaces, r = max{ri, . . . , Tjt}, / > max{l + 
max(T/i,0}, and the numbers k and m were defined for the matrix C{x,Dx) in Section 
in the scalar case, k = 1, t = ti = m, and at = rrih — m (see 12.11) . The operator (13.121) 
is Fredholm. From (I3.1ip it follows that a solution u of the homogeneous problem (13.101) 
satisfies x{^)'^{^7 Dx)u{x) = on dG^. This and the homogeneous boundary condition in 
fl3.10l) imply that u has zero Cauchy data on the set {x G dG^ : x{^) = !}• Under the 
condition of unique continuation theorem, it follows that the kernel of operator (13.121) is 
trivial. The triviality of cokernel can be proved in a similar way. 

As {£, B}, one can take, for instance, the operator {E.M} of elasticity theory; here 

S{x, D^)u{x) = -/iV^ ■ - (A + fi)Vx ■ u{x) 

is the Lame system with parameters A and /x, Af{x, Dx)u{x) = cr{u; x)h'{x), v is the outward 
normal, and cr(u; x) is the stress tensor. 



ajk{u, X) = n + — J + XdjkVx ■ u. □ 



4 Justification of the method for computing scattering 
matrices 

To justify the method, we have to verify that the matrix £^ with entries (I2.13P is nonsingular 
and the minimizer aP{R) of (12.111) tends to the /-th row of scattering matrix as i? — oo. 

Proposition 4.1. Let he incoming and outgoing waves ^2.0^ satisfying \2. Then 
{Muf,Vu^)^B^ - {Vuf,Uut)T!^ = TtSjk + 0(e-^^), 

for R — +00, where (3 is the number in the definition ofW in 2.1, i. e., < /3 < 5, where 
6 is in /fOI). 



Proof. According to (12.91) . 
{N'u,Vv)rR — {Vu,J\fv)YR = {u,Cv)gr + {Qu, Bv)gQR\-pR — {Cu,v)gr — (Bu, Qv)gGR\rR- 
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If u and V are elements of the lineal W introduced in 12.21 then the right-hand side of the 
last equality differs from q{u,v) by a term 0(e~^^) as i? — )■ +00. Hence 

It remains to take into account (12. 7p . □ 

Let M be a solution to a problem of the form A^{fJ,)w = (0, 0, h) with (0, 0, h) G 
71{A^{^) n L2(r^), where 7l{A^{fi)) stands for the range of the operator of problem (13. ip . 
In what follows, we assume that Vu G L2(T^). Moreover, we also assume that if v possesses 
similar properties, then for u and v there holds the Green formula (12. 9p . (Note that such 
assumptions have been fulfilled for the problems in Examples 1 and 2, Section O) 

Proposition 4.2. The matrix £^ with entries Ii2.13\) is nonsingular for all R ^ Rq, where 
Rq is a sufficiently large number. 

Proof. Suppose the proposition is false. Then for any R^ there exists a number R > R^ 
such that the matrix is singular, while U = J2j ^j'^] ^'^d V = Ylj ^j'^J satisfy 

VU = VV onT^, (4.1) 

where v~ is a solution to problem (12.120 and 1^ = (ci, . . . , cm) with |"cf | = 1. According to 
the equation on in (I2.12p . we have 

MU=MV onT^. (4.2) 

We set M = f = V in (12. 9p . take account of (14. ip . (14.21) and of the two first equations (12.121) 
and obtain 

(A/'W, VU)rR - (VU, UU\r = 0. (4.3) 
This and Proposition 14.11 imply that 

= z^|cjf + 0(1) = i + o(l), 
j 

a contradiction. □ 

Proposition 4.3. Let u be a solution to the problem liS. 1\) with right-hand side {0,0, h), 
while h G L2(r-^). Then 

\\Vu;L,{T^)\\^^^\\h;L,{T^)\\. (4.4) 

Proof. From (^M) it follows that 

{Cu,v)gr + (Bu, Qv)dGR\rR - {u,Cv)gr - {Qu,Bv)qgr\tr = 
= ((TV + iCV)u, Vv)rR - (Vu, {Af + iCV)v)rR - liCiVu, Vv)rR. 

We set f = M and obtain 

= {h,Vu)rR - {Vu,h)rR - 2iC\\Vu- L2{T^)f . 

Then 

2|C|||P«;L2(r«)f = |(/i,P«)r« - (P«,/i)rH| ^ 2||Pw;L2(mi||/i;L2(r^)|| 
and we arrive at (14.40 . □ 
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Proposition 4.4. Let a{R) = {ai{R), . . . ,aM{R)) be a minimizer of Jj^ in Ii2.11\) . Then 

JR {a{R)) = 0(e-2^^) asR^oo, (4.5) 

where 7 is the same as in Ii2.8\) . For all R^ Rq, 

\aj{R)\ ^ const < 00, j = 1, . . . , M. 

Proof. Denote by a solution to the problem fl2.10p with a^, j = 1, . . . , M, equal to the 
entries Sij of the scattering matrix S of problem (I2.3p . Since the asymptotics (12.81) can be 
differentiated, we obtain 

(a. + 2C)(>^^->^0lr = O(e-^«). 

The difference Yj^ — Yi satisfies the two first equations of the problem (13.11) with / = and 
g = 0, therefore flOl) holds for u = Yj^ -Yf. 

\\V{Y,^-Y,)-L,{V^)\\ <: \C\-'\\{U + iCV){Y,^-Y,)-L,iV^)\\<:ce-^^'. 

This and (12. 8p lead to the estimate 

M 

with constant c independent of R. Owing to J[^{a{R)) ^ J[^{Si), we have (14. 5p . 

Let us estimate the minimizer a{R). Denote by Zl^ the solution of problem (12.101) 
corresponding to a{R) = (ai(-R), . . . , aM^R))- We set m = f = in (12. 9p and obtain 

(AAZ,^,PZf)rH - {VZl',AfZP)rH = 0. (4.6) 

By virtue of fl43D 

M 

- {ut + 5^a,(i?)nT)); L,{r^)\\ = 0(e-^«), R ^ 00. (4.7) 

In view of 

M 

{N + iCV)Zf\rR = (Ar + zCI?)(^^^ + 5Za(i?),M-)|rK, 

i=i 

from (14. 7p it follows 

M 

- « + E «.(^)^ ))5 L2iT^)\\ = O(e-^^0, ^ 00. (4.8) 

i=i 

Making use of (14. 7p and (14.81) . we rewrite (14.61) in the form 
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where ipi = + 'Y^aj{R)Uj . According to Proposition 14.11 the left-hand side is equal to 
-2(1 - + oil). Thus, 

M 

J]|a,(i?)p = 1 + 0(1). □ 

Proof of TheoremlHSl Let F/, , and (ai(i?), . . . , aM{,R)) be the same as in Proposition 
14.41 Substitute u = v = Ui := Yi — in the Green formula (12. 9p . Since Ui satisfies the two 
first equations in ( I2.10p . we have 

{MUi,VUi)rR - {VUi,mi)rn = 0. (4.9) 

We set 

M M 

'Pi = ut + aj{R)u~, = M+ + ^ SijUj (4.10) 

and rewrite Ui in the form 

Ui-Yi- = (Yi - iJi) + - ^i) + - Zj"). 

Note that {Yi - ^i)\^r = O^e'^^) by virtue of (El]). In view of (ST]), (HS]), and Proposition 
14.41 this enables us to pass from (14. 9 p to 

{N{iJi - ipi)M'^i - Vi))tr - mi^i - Vi)M{'4^i - Vi))tr = 0(e-^«), (4.11) 
where A = min{/3,7}. The left-hand side can be immediately calculated and is equal to 

M 

rY^\a^{R) - Si,\^ + 0{e'^% 
i=i 

to see that, it suffices to use (I4.10p and Proposition 14. 1[ Finally, we obtain 

M 

5^|a,(i?)-^,,f = 0(e-^^).n 
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